ai model smaller and cheaper
Distillation Can Make AI Models Smaller and Cheaper
A fundamental technique lets researchers use a big, expensive model to train another model for less. The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it focused on the fact that a relatively small and unknown company said it had built a chatbot that rivaled the performance of those from the world's most famous AI companies, but using a fraction of the computer power and cost. As a result, the stocks of many Western tech companies plummeted; Nvidia, which sells the chips that run leading AI models, lost more stock value in a single day than any company in history. Some of that attention involved an element of accusation.
Country:
- Asia > China (0.05)
- South America (0.05)
- North America > United States > Pennsylvania (0.05)
- (6 more...)
Technology: